Run-3 4b skims

• tmux on cmslpc316
• missing input dataset file
• trying 2023_preBPix all eras (source skim2023_preBPix.sh)
• Fails b/c Input sandbox size exceeds the maximum allowed limit.
  • Created a clean checkout for the skim (used –depth 1 to speed up the checkout)
• Jobs finished. some error messages and missing chunks.
• submitting 2023_PBix … Done no errors

• Add event selection
• Test
• Submit
• Error from AK8 jet calibration.. Pinged AE.. fixed
• Waiting on updated pt calibration and nTag jet selection… have it.
• submitting BPix on 331
• submitting preBPix on

• Added script to do Lumi checking.
• Found missing LBs… turns out these are missing from the Nano!
• Checked with dasgoclient
• Can simplify the checking by just checking that the skims saw all the input events which we can get from das summary
• Make script to get the DAS info form the datasets file
  • First version working…
  • Need to fix py python/skimmer/metadata/get_dasinfo.py -d python/skimmer/metadata/picoaod_{datasetsdata2023BPix.yml}
  • …Done.
• Add README

• 2022 skims from last night failed… xrootd error … maybe voms-proxy ?
  • <font color=red>.. No due to MIT site problems </font>
• Rerunning on 346… failed will run period by period..
• Start preEE with B … done / Start C … Error /.Start D … done
• Start EE .. lots of errors

• Trying skims with blocksite blocklist_sites: 'T2_US_MIT' in /python/skimmer/metadata/HH4b.yml… didnt help
• Specified allowed sites"

allowlist_sites:
    - T3_US_FNALLPC
    - T2_US_Nebraska
    - T2_US_Purdue
    - T3_US_NotreDame
    - T2_US_Caltech

…worked! skims all good.

• saved yaml in archive
• made merged data set: = py metadata/merge_{yamldatasets.py} -m metadata/datasets_HH4bRun3.yml -o metadata/datasets_{HH4bRun3merged.yml} -f metadata/archive/skims_Run32024v2/picoaod_{datasetsdata202}*=
• Testing four-b skims…. Looks good
• Running skims locally …*49m55.899s* again on cmslpc319… 46m49.839s
  • Fails b/c of jet calib file… need to only rename if file not found.. fixed by only untarring when needed.
  • 45,881 events/s total (127711027/2783.5447924137115)
• Running skims condor…… 39m9.456s
  • 132,884 events/s total (127711027/961.0680384635925)
• Problem with the condor 4b skim… use the local v1 one.

• Trying condor 4b skims again on cmslpc339… see errors again…. 24m2.427s
• Making YAML for the four_tag dataset
• Now on to Run3 Synthetic Data

• on cmslpc303
• base_path: root://cmseos.fnal.gov//store/user/jda102/XX4b/2024_v3/
•  python runner.py -s -p skimmer/processor/skimmer_4b.py -c  skimmer/metadata/HH4b.yml -y 2022_EE -d data -e E F G -op  skimmer/metadata/ -o picoaod_datasets_data_2022_EE.yml -m  metadata/datasets_HH4b_Run3.yml --condor
• finished in 2386.692587852478
• python runner.py -s -p skimmer/processor/skimmer_4b.py -c  skimmer/metadata/HH4b.yml -y 2022_preEE -d data -e B C D -op  skimmer/metadata/ -o picoaod_datasets_data_2022_preEE.yml -m  metadata/datasets_HH4b_Run3.yml --condor
• … Has errors will likely need to rerun… moving on.
• Running now on cmslpc308
• `python runner.py -s -p skimmer/processor/skimmer_4b.py -c skimmer/metadata/HH4b.yml -y 2023_preBPix -d data -e A B C D E F -op skimmer/metadata/ -o picoaod_{datasetsdata2023preBPix.yml} -m metadata/datasets_HH4bRun3.yml –condor
• That fails (removing perdue) trying BPix…
• python runner.py -s -p skimmer/processor/skimmer_4b.py -c  skimmer/metadata/HH4b.yml -y 2023_BPix -d data -e D E -op  skimmer/metadata/ -o picoaod_datasets_data_2023_BPix.yml -m metadata/datasets_HH4b_Run3.yml --condor

• on cmslpc302
  • python runner.py -s -p skimmer/processor/skimmer_4b.py -c skimmer/metadata/HH4b.yml -y 2022_preEE -d data -e B C D -op skimmer/metadata/ -o picoaod_datasets_data_2022_preEE.yml -m metadata/datasets_HH4b_Run3.yml --condor
• Another ERROR… running one era at a time now…
• 2022_preEEB .. fails. Trying C .. OK. Trying D.. OK… keep going
• Now on cmslpc317
• Now on cmslpc318
• 2022_preEEB
• 2022_preEEC
• 2022_preEED
• 2023_preBPixA
• 2023_preBPixB
• 2023_preBPixC
• 2023_preBPixD
• 2023_preBPixE
• 2023_preBPixF
• 2023_BPixD
• 2023_BPixE
• Added T1_US_FNAL_Disk and blocked T2_US_Purdue .. fixed all previous failues
  • Also had to do set rucio_regex_sites: 'T[123]_(US|CH|DE|UK)'

• No missing files reported

• Checking event counts

  • eg: python skimmer/metadata/check_event_counts.py -y skimmer/metadata/picoaod_datasets_data_2022_preEEB.yml
  • All counts good!
  • Copied output yml files to metadata/archive/skims_Run3_2024_v3/
• Merging python metadata/merge_yaml_datasets.py -m metadata/datasets_HH4b_Run3.yml -o metadata/datasets_HH4b_Run3_merged_v3.yml -f metadata/archive/skims_Run3_2024_v3/picoaod_datasets_data_202*
• Moved datasets_HH4b_Run3_merged_v3.yml to datasets_HH4b_Run3.yml
• Now to four-b skims…
• Command in =skimmer-fourTag-job.sh =
  • python runner.py -s -p skimmer/processor/skimmer_4b.py -c skimmer/metadata/HH4b_fourTag.yml -y 2022_EE 2022_preEE 2023_BPix 2023_preBPix -d data -op skimmer/metadata/ -o picoaod_datasets_fourTag_data_Run3_v3.yml -m metadata/datasets_HH4b_Run3.yml --condor
• submitted on cmslpc330
• now running on cmslpc341

• on cmslpc318
• Trying 4b skims locally
  • python runner.py -s -p skimmer/processor/skimmer_4b.py -c skimmer/metadata/HH4b_fourTag.yml -y 2022_EE 2022_preEE 2023_BPix 2023_preBPix -d data -op skimmer/metadata/ -o picoaod_datasets_fourTag_data_Run3_v3.yml -m metadata/datasets_HH4b_Run3.yml

an in 1508 s = 25min

• Merged fourTag skim datasets
  • python metadata/merge_yaml_datasets.py -m metadata/datasets_HH4b_Run3.yml -o metadata/datasets_HH4b_Run3_fourTag_v3.yml -f skimmer/metadata/picoaod_datasets_fourTag_data_Run3_v3.yml

• Rerunning skims after [BROKEN LINK: 9058CACF-33CB-48C6-AD39-A423366C0D23]

• Skimming on cmslpc302
• Add skims output to archive/skims_Run32025/
• Making merged dataset
  • python metadata/merge_yaml_datasets.py -m metadata/datasets_HH4b_Run3.yml -o metadata/datasets_HH4b_Run3_2025_Run3_skims.yml -f ../archive/skims_Run3_2025/picoaod_datasets_data_202*
• Making 4b skims
  • python runner.py -s -p skimmer/processor/skimmer_4b.py -c skimmer/metadata/HH4b_fourTag.yml -y 2022_EE 2022_preEE 2023_BPix 2023_preBPix -d data -op skimmer/metadata/ -o picoaod_datasets_fourTag_data_Run3_v3.yml -m metadata/datasets_HH4b_Run3.yml --condor
• Failing… missing files… Trying locally… works!
• Made dataset:
  • python metadata/merge_yaml_datasets.py -m metadata/datasets_HH4b_Run3.yml -o metadata/datasets_HH4b_Run3_fourTag_2025_skims.yml -f skimmer/metadata/picoaod_datasets_fourTag_data_Run3_2025_skims.yml
• Testing
  • python runner.py -o data_Run3_2025_skims.coffea -d data -p analysis/processors/processor_HH4b.py -y 2022_preEE 2022_EE 2023_preBPix 2023_BPix -op output/synthetic_dataset_analyze_all -c analysis/metadata/HH4b_run_fastTopReco.yml -m metadata/datasets_HH4b_Run3_fourTag_2025_skims.yml
• Now on cmslpc336

ERROR    ERROR:root:The whole file is missing:

"root://dcache-cms-xrootd.desy.de:1094//store/data/Run2023D/ParkingHH/NANOAOD/22Sep2023_v2-v1/2560000/c493171c-63f5-4906-b09a-ac5684089bb0.root"
"root://dcache-cms-xrootd.desy.de:1094//store/data/Run2023D/ParkingHH/NANOAOD/22Sep2023_v2-v1/60000/184bebb8-5e35-41d2-86b6-cc02c0307489.root"
"root://dcache-cms-xrootd.desy.de:1094//store/data/Run2023D/ParkingHH/NANOAOD/22Sep2023_v2-v1/60000/69155626-c909-4645-b8e4-31e5024d609a.root"

202410081033